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ABSTRACT 

This study was conducted to explore variations m 
esphasls on teaching for higher-order thinking m secondary schools. 
Three explanations are considered: (1) conceptions of teaching and 
learning encourage teachers to pursue higher-order objectives 
primarily when teaching high-track students and advanced courses; (2) 
lack of adequate preparation to teach higher-order thinking; and (3) 
asi^cts of school organization discouraging teachers frm pursuing 
higher-order objectives. Secondary teachers in 16 schools were asked 
to identify instructional goals for eacti of their classes. Scales, 
intended to capture the emphasis on higher-order objectives m nath, 
science, social studies, and English, were constructed and evaluated. 
Findings revealed that math classes differ in instructional 
objectives because sath teachers tend to differentiate objectives for 
different classes, while social studies classes vary primarily 
because of differences among teachers; school-to-school variation was 
exhibited in English and social studies, but not m math and science; 
the effect of tracking on higher-order objectives is powerful in all 
disciplines, but especially in math and science; and effects of 
teacher preparation and organization design were manifest in English 
and social studies, but not in math or science. Implications for 
policy and future research are considered. (Author/LL) 
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Afastxact 

We cjcnsider three explanaticais f ca: variation in essphasis cm teMhing 
for hi^ifir-oarder thinking in US secxsidary classrocans: 1) cxjixaepticns of 
tMKiiing and leeffning rooted in the seocaxJary school curricailum enoour^ 
teaciiers to pursue higher-order dsjectives pariaiarily teaching hi^- 
track studenls ani advanced courses; 2) many teachers lack adequate 
pr^)araticn to teach for higher-order thinking; and 3) adjects of school 
organization discourage teachers frm pursuing higher-oorder objectives. To 
test hypotheses flowing frcm these explanaticais, we asked seccaidary teachers 
in 16 schools to identify tteir ii^tructional goals for each of their 
classes. From tl^ir xespanses, ws cOTstructed and evaluated scales intended 
to capture the ei|iiasis on higher-order oisjectivBs in math, scienoe, social 
studies, and EJiglish. A variance deoonposition revealed that math classes 
differ in instructiOTial objectives primarily because eac^i math teacher tends 
to differentiate her objectives for her different classes, \Aiile social 
studies classes vary primarily because of differences among social studies 
teachers. School-^to-school variaticsi was manifest in Eiiglisii and social 
studies but not in math and scienoe. A three-level hierarchical regression 
model revealed powerful effects of track on higher-order objectives in all 
disciplines, but especially in math and science. Effects of teacher 
pr^iaration and organizatic»i design were manifest in Biglish and social 
studies, but not in math or scienoe. Ihs differentiatirai of instructional 
ctojectives based an student track is s^jparently de^ly institutionalized in 
all subjects, but particularly in math and scienoe. In?)licatiais for policy 
and future research are considered. 
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Over the past 60cadB, r«jearcii cxi tesKzhing has undergone an iapartant 
transf onraticjn as researti*eES hav© turned their attenti<xi fron instnK±km 
for basic skills towarti teacSiing for hio^ier-caxter thinking (Bereiter and 
ScardamaUa, 1987; Petersai, 1988; Prawat, 1989; Newmann, 1990) . This change 
results trcm a wide^aread perx5e%/tion that US schools are ocaparatively 
ineffective in cultivating ocnc^Jtual understanding of ac»3€aiic subjec±s. 
Tar exanple, reoer,t large-scale assessments deiwistrate that altto*Kfi US 
students perfom adequately m tests of basic skills, th^ perfom 
oOTparatively poorly on tasks that involve prcA>lfim solving, critical 
analysis, and flexible understanding of aibject matter (IB Department of 
liaucation, 1991: 32-41) . In this light, teaching for higher-order thinking 
is increasingly aoc^Jted as a goal toward v4iich the education professicsi 
should strive. 

RBceant conroentary and research also eacphasize that teaching for higher- 
carder thinking is ijiixartant for the learning of all students in an 
acKteraic subjects. For exan|>le, Peterson (1988:2) cites research suggesting 
"the need for an increased instructicsial focus on teaching hi^ier-level 
skills in mathenatics to aU stistents. aich an increased focus miq^it be 
particularly iaportant for lower-achieving stusfents, vdio have roore 
difficulty than tl^ir peers in learning tl»se higher-orte skills on their 
own." With re^ject to seoMidary social stiMies, Newmann (1990:48) proposed 
that teaching for higter-order thinking is iii?sjrtant for all learners: 

. .Any person, young or old, regardless of experience, can partic^te in 
hi^ier-crxfer thought. Students wiU differ in the kinds of challenges they 
are able to roaster, but all are enable of ocsifroaiting a chaUenge in the 
interpretation, analysis, and manipulatirai of knowledge." Dcyle (1983) also 
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reviews researdi ijxiicating that teaching cognitive paxsoesses and knowled^ 
stnictur^ can be of ^Jecial benefit to lower-achieving students. 

De^ite the onerging consensus on the iaswrtanoe of teaciiing for 
hi^rer-atxter thiridng, researdi ^nerally finds that classrocm instruction 
in high sctwols is focused an basic skills (Goodlad, 1984; Powell, Cohen, & 
Tarrar, 1985). Ito the extent that teaching for higher-order thinking is 
manifest, evidence suggests that it occurs far sore oftei in high-trac3c than 
in low-track clas^ (Metz, 1978; Oakes, 1985; Page, 1990) . Ohus, at the 
hi^ school level in the Iftiited States, a sharp ccaitrast exists between 
current visions of educaticaial esKsellenoe and currently institutionaUzed 
patterns of ediKaticaial practice. 

In this pE^ier, we cca^i<ter and test several e3q)lanatiOTS for the 
aj^arent dimities across IS secondary classroans in teaching for hi^- 
order thinking. The first es^lanaticai tolds that hierarchical c .jo^ptions of 
teaching and learning are de^ly entodted in the hi^ school curriculum and 
that these cc»wQJti(XTS disooura^ teachers frcro onbracing higter-ooaer 
instnictiOTal goals exc^ te^iui^ the most aivanced students in the 
most advanced ^abjects. If this explanation is credible, we should expect 
instrwrtional goals to vary within te^iiers. Ihat is, when the several 
classes taught by a givai high school teacher vary in terms of the presumed 
acadsnic ability of their studarts or the level of subject matter to be 
tauj^t, that teacter slwuld place more Qi?3hasis on teaching for hicfier-arder 
thinking vdien teaching hi.^-trac3c stasaents and when teaching more advanced 
subjects. Mcnreover, this tendency of a teacher to differentiate 
instructional goals across classes should be most prcaxjunoed in those 



academic disciplines that are most clearly differentiated on the basis of 
student ability and level of course diff iailty. 

A seocavl explanation ei?4iasizes dif fesrswes sacenq teacisrs rather than 
differences within tead^rs. toxicdiiig to tiiis view, variations in teachers' 
subject-matter lawwledge and peda^ical eiq)ertise are critical in 
undfirstaKiing diffemwes ammg teactsers in instnjcti«»l ^als (auilnan, 
1987) . Vfe hypothesize that more hi^y e d »Tc a t ffrt and experieKed teachers, 
who ar« presumably laore krawledgeable about their discipline and have 
acquired more pedagogical expertise, will aribraoe hic^her-order instructional 
gosLl3 with hi^ier f recp^xy than will less edi^ted or less experienced 
teacters. We also iroresti^te the effect of a teacher's preparation to teach 
the specific oraitent of each class to which the teacher is assigned. We 
hypothesize that when teacher preparaticai matci^s the content, the teadier 
will be xoore lilcely to pursue higher-orto instrur,titaial ^als than vdien 
preparation and content match poorly. Ihe adfiqu?.cy of the inatiii wiU d^jend 
both on the teacher's overall pc^>aration and oti the process used to assign 

teachers to courses. 

A third explanation focuses on the organizaticsial envire»inents in which 
teachers worfc. Recent work on sctool restrixituring, for exauple, suggests 
that bureaucratic rules that closely regulate or routinize teachers' work 
will discoura^ the pursuit of higher-onter instructional goals vdiile 
oarganizational envirmnaits characterized by a^^xartive administrative 
leadership, hi^ levels of teacher collaboration, and strcaig teadier 
control over instruction will facilitate the pursuit of sucii instructional 
goals. AccoExiing to reasoiing tecribed in detail later, organizatiCTial 



enviroranmts can be &qpes±ed to praissB variati«i in instriKAioned goals at 
two levels: ancng tte teachers within a sctool an;! aocsig schcx>ls. 

Iteing teaciiers' self-rgxarted esi?*iasis cai teaching for higte-cctfer 
^aals in each of tl» classes they teacii, we examine the incidence of 
teaching for hi^»r-on3er thiridng in a saaple of 1205 classes tai^t by 303 
EKadanic teachers in 16 diverse high scSiaols in California and Miciiigan. 
Ihe ti.ree e3?)lanati<xis we ocmsider inply that teachers' goals will vary at 
each of three levels: within teachers as a functicai of characteristics of 
the classes a teadier encounters; anmg the teaci^rs woricing in a partiaalar 
school; and across scSkjoIs. Aooordingly, we €snplcy a three-level 
hierarchical limar model that enables us to deconpose variation in 
irstr\jcticml cpals into these three ooijxaiaits. Vfe then eaplcy predictor 
variable measured at each of these three levels in an attenpt to account 
for ttm mariifest variaticsi at eadi level. Ihis procedure is r^licated for 
eacdi of four major acadanic disciplines: matheanatics, science, social 
studLies, and E^lish. 

We begin by reviewing the logic untierlying the three e^^Jlanations for 
variaticai in hi^ier-order instmctional ^aals. We tl^ describe in detail 
tte methods we use to test these e)5)lanaticais, including the scales used to 
measure ei?3hasis on higher-order instructional goals in each discipline. 
Finally, we turn to the results and implicatior^ for research on teactiing 
and school reform. 

AltecmtivB fiqplanatians and Hypotlieses 

ccmc3^iop « »f Turn ing Rooted in the SeoQ»c3ary Sc^iool curri<?aum 

A number of studies have r^xscted that c la ss es serving hi<^-achieving 
students are substantially more liXely than classes serving Icw-^achieving 
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students to &!spt&sizB higher-orcter thirfdi^ pcooesses (Hargreaves, 1967; 
MBt2, 1978; OakiBS, 1985; 1990). A picture emerging from quaUtative 
aocxjunts is that educators asnnonly presume less able stuaents to he 
capable primarily of rote joawrizaticsi and procedural knowledge. In this 
view, B»re able studoits can apply Jmowledge ond analyze prdalens as a 
preluiie to thinking about alternative soluticais. Ifcwever, only the most 
able students can syntteize aaitrastii^ po.t^ta of view onaer to develop 
new theoreUcal fanailaUons, to prxspose and c^end alternative solutions to 
problesns, or to evaluate critically alternative courses of action. 

Several ei^lanations might be offered to aoooait for the di^arity 
between high- and low-achievii^ classes in the instructicsial goals teachers 
have been found to pursue, ffetz (1978) has argued that teactors resort to 
basic skills instruction in classes serving low-achieving students as a 
classrocan manageaent strategy. In this view, the routine tasks and slow pace 
of work that acccaipany mach basic skills instructi(^ ke^ low-aciiieving 
stuitenfcs busy while aoocatsnodating their preferences for ^sy work. 

Neo-Marxists a«i critical tteorists, on the other hand, see the 
disparity in instrricticai across acactenic tracks as flowing fron the 
eAicaticxial system's role in reproducing social inequality. In this view, 
tracking and ability grat?)ing sort students on the basis of social class and 
ethnic background and then provide them instruction consistent with their 
future ooa?>ational destinies. Ihe iK»ti«i that low-tracOt stasients are 
incapable of critical reasaiing prepares these stisients to aoo^ 
subcsrdinate social roles vAiile the presumed superior cognitive powers of 
the high-track stiKtents justify the more prestigious and powerful social 
roles they will later ooo^jy (Bowles and Gintis, 1976) . 
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Uie pervasive inf lusnoe of behavior ian in omriculm and ijnstxucticn 
pcosdd^ a final pc?tential esqOanation far variation across US seaogndary 
classpg in the pursuit of hic^le3^-aE:tler instructional goals. As St^epsrd 
(1991) dsncaistrates, bdiaviarist theories iuply that students learn best 
when ocaplex learning tasks are trcten down into smaller parts that are 
learned sequentially. Only wten the earlier, single steps are luastered is 
the learner ready for more ocopiex tasks requiring analysis, hypothesis 
testing, and cxitical evaluatic»i. This view of learning way lielp acxxunt fco: 
the differentiaticai of teaching dajectives fcy studatt ability. Irhf 
achieving students nay ctirmically experience loi^r-caoder ij^tnK::ticinal 
esipliasis because educators view these stusfents as "stuck" in the early 
phases of the learning process. In cxsTtrast, the hi^ier-achieving students, 
having mastered the basic skills, may be viewed as pce^pared to handle nore 
oonplex learning tas^. 

Indeed, Peterscai (1988:7) criticizes the traditiml eieamentary school 
mathematics curriculum "as based cen the a^un^jtion that ocai^putational skills 
mist be learned before children are taught to solve even sinple word 
problems." At the seocaitory level, the curriculum also reflects this 
seqtwTJtial notion. For exanple, in mathaaatics, US studaits ocamocaily take 
pre-algehra, thsi algetea, then gecmetry. It is ccamnan to vi&i hi^ier-order 
dbjectivBS as nnre apprqpriate later in the sequence: proofs are expected in 
gecsnetry hut not adgebra; matteatical reasoning is more appropriate in 
algebra than pre-ai^sbra. As students progress through the grs3^, o?ily ti^ 
more able stud^its appear to keep vp with the academic mathesnatics 
curriculum, so that most will fall away before they encounter truly higher- 
order instnK:±d.c»icd objectives. 
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The interpretaticns we have <tescritoed are not mitually esclmive. 
Ifeaciisrs mi^t oaphasize lo^level objectives in law-track classes as a 
ciassrooQ mana^n^ strategy even if the larger «&catianal system 
functioned to r^sroduce inequality in adult status. And neitJ^ of these 
views pc^clixJes tl» possibility that tl» curriculian has been obstructed to 
facilitate a behaviorist cwioeption of learning in vftiicii masterong basic 
^lls is a necessary preluste to higher-onter reasoning. Ihese per^)ectivBs, 
taken together, suggest two hypotlieses: 

HI ThB hi^ier the academic track cf a class, ttm more 
likely a teacher will be to report an cai|4iasis an teazling for 
higher-onJer thinking in that class; and 

H2. U» higher tl» grade level of a class, ti^ is^e l^ly a 
teacto will be to r^xsrt an ei|4iasis on higher-order thinking in 
that class. 

These effects of track and grade may not c^jerate similarly in each of 
the major acadanic disciplii^s. As Stodolsky (1988) points out, 
disciplinary specializatiwis in ti^ US are founded on different 
epistemological bases. Iherefore, there may be real differences in the 
degree of hierarciiical curricular or^zaticm across the disciplines, with 
tte result that the effects of track and grate will also vary. For exanple, 
the US mathonertics curriculum tends to be sharply differentiated by track. 
College-bound students take i markedly different sequaxss of cairses than (to 
vocatioial or geiieral track stixSents. Ifcmrs studaits often take yet a 
different sequence. Moreover, the prescribed sequence of oowrses tends to 
be especially rigid in math (e.g. , algebra before c^anetry before 
tri^»ica«etry) . Ihe science curriculum is similarly quite differentiated ly 
academic trade, and tte prescribed sequence of courses fairly standardized 
(though not as standardized as in math) with biology preceding (dismistry 
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preceding physics. On the other hand, the serial studies and Biglish 
curricula ^jpear less differartiated in both ways. Qsurses aare often have 
the same labels for oollege-bcund and nca«ollegs-bound stud^ts and the 
seqi^nce of courses is nrare flesdhle.^ These differences may be related to 
tl*e different social functicsis served by the several disciplines. For 
exanple, it is aamxm to view mth as critical in gate-Xe^ing decisicais 
determining later coa^ational attairanait, y&iile social stasiies is essential 
in promoting poUtical socialization. It would tterefore be functicaial for 
the math curriculum to be highly differentiated by ability and age but 
d^rsfunctimal for the social stiKiies curriculum to be similarly 
differentiated. 

Ihe notion that the disciplines differ in their <tegree of hierarchical 
organization leads us to a third hypotl^sis: 

H3. "nie effects of track and grad^. level an teaching for 
higher-order thinking should be greatca: in math and science than 
in Qiglish and Social Studies. 

In summary, discussion to this point has focused an intra-teacto 
variatiai in teaching for higher-onter thihlcinr^. ^ have ocHijectured that a 
given teacher intentionally differentiates instructional goals across the 
various classes he or she teaches and that wten teaching younger students or 
students in lower academic tracks, a teacher t&nds to places less ei?hasis 
on higher-order instructiOTal objectives. If siKh intra-teacher decisis 
processes vrere the only source of variation in teaching for higher-order 
thinking, then variatitsi amcfig teachers would arise oily to the esctent that 

preljjidnari' analysis of the data used in this stucfy confirms these 
ideas. Wte examined cxwrse titles by trac3c designation, course titles 1^ 
grade level, and ttm amount of abiUty groi^ii^ by subject area. TSsse 
Salyses lent suj^wrt to the notion that math and science tend to be moTQ 
rigidly seiiienoed and tracked than do social studies and Qigli^. 
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scsne teacters were assigned to teach mcB hic^-trac'c or high-grajte classes 
•Chan Mere other teodMrs. Ws would that cxaiclude that the effects of tracic 
and grade are deeply instituticmlized in cxaioeistions of teaching and 
leamii^ that are essentially invariant acrrss teachers aw? organizational 

Ttearfier Background and TraiJ^inq 

An exclusive focus m intxa-teachsr janooesses neglects effects of 
relatively stable differences in ttm bEKdcground and preparation of teachers 
cffi teaching for higter-order thiridng. Yet these differences might be 
ijnpoitant in understandirg the variaticai in instn^tional objectives that 
stuctents encounter. Itee has been coisiderable ocsnmaitary on the kinds of 
pt^aration and Imowledge teachers need in arfer to teach effectively for 
higher-order thinking. Talbert and colleagues (1990) extensively reviewed 
this literature, focusing on two types of knowledge; in-d^Jth kna/ledge of 
subject matter and "pedaOTical contait Jofflwlec^" (Shulnan, 1987) , that is, 
in-d^rtOi knowledge of 1k3w to teach the subject matter. Iteachers v4io lac3c the 
required knowledge aj^arently resort to "teaching the facts." An en?3hasis on 
transaoitting procedural and factual infomaticm allows teachers to ocantrol 
the flow of classrocm interactirai, therety avoiding challenging discourse or 
re^jcnding to stiKient challenges or questions that require a deep 
imderstanding of the subject matter being taui^t. 

In this p^Jer, we index U^c^.crs' broad subject^natter knowledge by 
reference to teachers' level of educatiai, and we index broad ped^pjgical 
knowledge by reference to years of teaciiing esqaerienoe, under the assuospUcxi 
that more hi^y educated and experienced teachers know tteir subject areas 
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better and have aojuired more pedagogical e>?)eirtise. mis reasc •? 
generates two h^pothBses: 

H4: Ihe hi*^^ a t^chor's level of educaticai, the greater 
the lilcelihocsd that the teacher will enjahasize teachiiig for 
higher-order thiridng> and 

H5: The more years of teaiching a<peri«we possessed fcy a 
teacher, the greater the lilcelihood that the teacter will 
en^tesize teaching for hic^ier^^Jcdfia: thinking. 

These hypotheses relate teacher background to a broad predi^xasiticsi to 
teach for hi^^aoarckar thinking. However, tha knowlecS^ required to teach 
for higher-orxJer thinking is undoubtedly hi^y specific. For exanple 
•KObert et al. (1990) discasss situations in which teachers who are gaierally 
capable of teaching for higher-onter thinking do not teadi in this way 
because of a mianatch between their knowlec^ and the particular cantexrt of 
the course or lessai tl«y are assigned to teach. In fact, Talbert et al. 
(1990) argue that "cross-^csver" teaching — teaching oat of tsie's subject 
area strongly predicts "transnission" style instruction, which they view 
as the cjpposite of teaching for understanding. In this p^jer, we into the 
specific pr^aration of teachers by their r^xjrts of the de9ree to which 
they feel pr^>ared to teadi each of the courses to vdiicii they are assigned, 
suggesting the following hypothesis; 

H6: The nore prepared a teacher feels to teacii a particular 
course, the inore likely that tea^aier will be to enj^iasize 
teaching for hi^her-arder thinking in that course. 

CXir hyFrthc£«3 regarding effects of teacher edification and exparienoe 
{H4 and H5) are hypotteses about predictors of intey-t^a^^ variatim in 
instructional objectives . In ccsitrast, the l^^pottesized effects of the matci; 
between a teacher's pp^>aratiai and the ocartant to be tau^t in a 
partioilar class are, in part, intra-teacher effects. To the extent a 
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teaciier feels difftecentially well prepared to teach in the several classes 
assigned, that teacher's iiistrvK±ional goals are expected to vary acanoss 
thsse classes. Of course, it might be that scaoe teachers are, on average, 
better-prepared to teach their clasaes than are other teachers, txaiUibuting 
to inter-teacher variaticm in instructicnal goals. 

Finally, recent research asserts a relatioiship between the formal 
organization of schools and tl» distribution of teaching for hi^ier-order 
thinking. For exanple, Darling-Hanmond and Wise (1985) argue that the work 
of teachers is becoming more rout ini zed and regulated as state education 
agencies and local school systess increasingly ir^lesnent standardized 
curricula and use standardized tests to ass^s the perfomance of s tuden ts, 
teachers, and schools. 

Available evidence suggests that teachers alter their instructiOTal 
practices in re^xanse to these polici^ {Bullcwgh, Gitlin, & Goldstein, 
1984; Darling-Hansncaid and Wise, 1985; Itoseriholz, 1987; for a review, see 
Rcwan, 1990) . Because available texts and tests tend to stress "low-level" 
cognitive skills, and because taureaiKxatic pressures for aooountability 
force teaciiers to use "direct instrtK^ion" to teacii to these tests, 
instruction is allegedly beccaning inore hi^y focused on basic skills. 
Moreover, teachers ^^sear to alter the pace of instruction in response to 
bureaucratic policies, stressing content ooverage over depth, a practice 
that Newmann (1990) has argued is inocar^atible with teaching for hi^ier- 
order thinking. 

Ihese ideas suggest that two organizatiOTal features of schools will 
have direct effects cn tead^ors* eniAiasis on hi^ier-onter thinking: the 
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extent to stawianiized tasts of stutot achieveaent are ised to jud^ 

the quali^ of teaching and the extent to whic^i teacSiers feel <*ligated to 

"cover the curriculum." In our view, these organizaticaial features will 

jaxxibice variation at tso levels of our model. To scsae extent, aoocwntability 

systeis and pressures for curriculum covbte^ operate at the sdwol level 

and should prodia» inter-scfaool dif fenenoes in teaching c&jjectives. At the 

same tiane, iKwever, previous re^arch demonstrates that not all teachers 

will feel these pressures equally (Bowan, Rauderilwsh, & Xang, 1991) . 

Iteachers who iitobit different locaticais within the organizatiOTi of the 

school may differentially perceive such pressures car may re^xaid dif f eraitly 

to them. Wfe shall test the foUowing hypotheses: 

H7; To the extait a teaSiPr feels that the quality of his or 
her teaching is j\^o^ cs\ the basis of stancJardized tests, that 
teacher will be less likely to teach for higher-order thiricing; 
and 

H8: To the extent that a teacher feels pressure to "cover 
the curriculum," that teacher will be less li3cely to teach for 
higte-order thinking. 

As we have seen, aaKh of the dehRte about atganizaticaTal influences <xi 
teaching for higher-order thinking has centered around the negative effects 
of school bureavKxatizaticHio Ifcwever, an equaUy inportant line of work has 
enjhasized the inportanoe of school restructuring to prcanote teaching for 
higher-order thinking. In this argument, such teaching will require the 
develc^ment of a oollegial "learning ocajsnunity** amcaig teachers, si^jjxsrtive 
leackastiip frcan school administrators, and more control teactes over the 
kinds of instrix^ional policies and proosi^es thut currently eraxaarage a 
focus <»i low^level cognitive skills. As with tureaucxatic controls, we 
expect that schools might syst««matically differ on these dimensions, txit 
there is also stnaig evidence that teachers within the same school vary in 
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the extent to vihich they receive aininistrative si^port, join with otiier 
teachers in collaborative relaticais, and obtain ocattrol over in^xartant 
instiiKtiOTal policies (Kowan, et al., 1991). Ihus, as with l^potteses about 
bureaucratic c«itrols, we acid hypotheses about ttese organizaticml factors 
to predict inter-teachea: variaticai: 

H9: The wsre a teacher receives si^^xart frcm school 
administrators, participates in ooUaborative relaticms with 
other teachers, and exercises oontxol over key policies an the 
areas of curriculum and instruction, the more liXely that teacher 
will be to emphasize teaching for hic^ier-onier thirtdng. 

Data 

Data for the stuc^ were collet in 16 high schools in California and 
Michigan- Ihe 16 schools were chosen purposefully to guarantee diversity in 
seocsidary school teaching oraitexts in tenns of state policies, district 
resources, sci^l organization, and student ocoposition. In the ^ing of 
1990, questionnaires were administered to all teachers in these schools. 
Re^xanse rates varied f rcsn a low of 50% to a hi<^ of 100% with a median 
res^xxise rate of 75%. Mathanatics, science, social studies, and ESiglish 
teachers were administered a ^jecially tailored, subject-specific 
questionnaire that asked them to r^xart informaticHi cm each of the classes 
they were teaching. Uiis procedure yielded cao[$>lete data on 1205 classes 
tau^t ty 303 acadesnic teachers. 
Characteristics of th e Classes 

Table la presents (tescriptive statistics an characteristics of these 
1205 classes. The average class size was 25.69 students (sd = 6.47). Grade 
levels ranged frcan 1 = freshman to 4 = senior (m = 2.34; s.d. = 1.00). In 
the analyses below, we included class size as a otaitrol variable. 
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Ittsert Table X Abcsut Hexe 



Far each class, academic teachers ware asked to classify ti» acadeanic 
track of tte class aocordingr to tl» following coding sciiane: vocational, 
general, college-bound {nc»rtiOTars) , hasm, and mixed, m this sanple, mly 
four perxxmt of the classes were described as nixed, iirplyijig that teactors 
l)ad little difficulty in classifying tteir classes aooarding to track. Mixed 
classes v?ere dropped from the analysis. For purposes of ti» analysis, taro 
indicator variables were created: an "haxars" indicator todc csi a value of 
one for honors classes, zero otherwise; and an "acadsnic" indicator took an 
a value of one for coUe^bcsmd (non-hcaiDrs) classes, zero otterwise. Ohe 
classes having values of zero on both indicators were the vocational and 
general track (non-college) classes. Table la shows that of the 1205 
classes, 192 (16 %) were hcsTors classes, 506 (42 %) were acadaaic but not 
hCTTors, and the r^naining 507 classes (42 %) were either ^neral or 
VDcati«ial tiack classes. Iteachers were also asked to report their specific 
level of pr^jaration to teach esxii class. This variable was reooded as an 
indicator variable that took cai a value of one if a teacto: felt ••very well 
prepared" for that class, zero otherwise. In 61% of tl^ classes, the 
teachters felt very well prepared. 
Characteristics of Tte acfaers and School Organizatjcy? 

TablA lb presents descriptive statistics for variables measured at the 
teacher level. The first set of variables ctescribe the education and 
experience of teachers. Teachers in this sanple were both hi^y 
experienced, with mean years of experience = 20.02 (s.d. = 9.15) , and hi^y 
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^yrah^ (70 % with Bfisters degrees) . We also collected data cai sex and 
ethnic kactapxjund: 91 % were vdiite, and 61 % were roale. 

niree scales were cxnstrvicted to fflaasure the organizational 
enviiOTnaits in vftiich *-.eachers worked. As d i m yy^e d above, we view these as 
teacher-level variables, in part because re^xaises reflect teaciier 
peroepticais of characteristics of their schools; and in part because 
previous research has found that these measures vary within schools in 
response to teacher locatitats within the academic division of labor (Rowan 
et al., 1991) . Wte note that gl<±al differeixaes in school organizatiOT not 
measured here, as well as differences among schcols in stud^it oon^xsition 
and rademic udssicm, are taksi into axxwnt by including in the model a 
school-level variance ocsipsient. 

Bureaucratic pressures on teachers were measured lay two Litert-type 
scales. Pressures arising fran standardized testing were assessed by an item 
that asiffld teachers about the eactent to which colleagues " jisig^ the quality 
of w teaching c»i the basis of itty stuttents' achievement gains" (m = 3.97, sd 
= 1.27) . Pressures for curriculum coverage were a s s e ss p d fcy asking te^iiers 
the degree to which it was iii?xsrtant to "cover the curriailum" (m = 4.51, sd 
= 1.15). 

Variables measuring a^)ects of sciKaol organization hypothesized to 
pronote teaching for higher-order thiriking were measured by scales used in 
previous research (Pallas, 1988; Rowan, et al. 1991) . Si??xsrtive principal 
leadership was measured by a 13-iten scale with itens indicating sikSi 
diverse principal activities as effectively coping with outside pressures, 
setting priorities, recognizii^, encouraging, and supporting staff, and 
involving staff in ctecision making. Internal ocaisistency was .92. The extent 
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of staff coc^jeration and oollegiality aaBasured by a scale incauding six 
itme, indicating the extent to \diich staff aessbers help each other in 
divei-se duties, share beliefs and valiies about the centzal mission of the 
school, naintain imifomly hi^ standards of perfomanoe for theanselv^, and 
sesk new i(teas. Inteamal oonsistaicy was .86. Te&disr oontrol is a nine-item 
scale indicating teacher oontrol over student behavior codes, content of 
inservice pragrams, studa:it grciping, school curriculum, text selection, 
teachinq content and techniques, and amount of hcraewock assigned. Internal 
consistency was .75. Ihese measures show a close oorrespcHidenc* to ideas 
presented by Hosentolz (1985) and Little (1982) about the characteri'stics of 
effective sciMol organization. 

Measures of Teaching for Higher-Qnisar Uiiiiking 

Ute outocane of interest in this p^^er is the amount of ^i^iiasis 
teachers place on higher^-order thinking in each of the classes they teach. 
Ihe tern higher-order thinking has inultiple intellectuzd roots, tut in 
current \asage it has ocsne to derate a form of cognitive uncterstanding 
constituted by knowing the general patterns and principles in a particular 
knowledge dcraain and by oonprd^eriing the relationships among these 
patterns and principles. Moreover, higher-ortter thinking has oane to denote 
the application of such knowledge in problem-solving (Cole, 1991) . 

AltlKJugh hi^MT^-onler thinking undoubtedly shares ocanaon features 
acsx3ss disciplines, we decided to treat the pt^KsnaiQn as discipline- 
qaecif ic rather than generic. We therefore desvel<?jed separate measures of 
teaching for highesr-order thiniking for mathematics, science, s oc i a l studies, 
and Ehglish. In science and math, we used itans develc^jed as part of the 
NELS 90 survey, administered the Natic»ial Center for Dducaticai Statistics 
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By cOTtrast, items for social stixiies and Bxflish are ariginal in tiie 
current stucty. 

Because the ^welopnaTt of measures of teaching for hic^ier-order 
thiridng was, in itself, informative about instruction in high scSiools, wb 
r^xirt on this mftasurement work in soaae detail. In each of the four 
questiOTiaices, we used a set of eight discipline-specific ituas that a^ked 
teachers to rate the degree of en^Jhasis they placed cai particular learning 
objectives for each of the classes tl^ tau^. Degree of esifhasis on an 
cft>jective was indicated by a four-point Li3cfirt scale including the ctioices 
••ncffie", "a Uttle", "moderate", and "heavy*' oiqphasis. 

The scale for each discipline included iteros intended to indicate bot2x 
"hi^ier-oarder" and "lower-order" dsjectives, where the latter involve tasks 
requiring memorization or the <fevelc?snent of procedural skills. We es^wcted 
that re^xaises to iteros included wcsuld be sorted aooording to whether they 
indicated hi^-.^-<3rx3fir or los*er-order dajectives and that the two sets of 
responses would be quite highly negatively correlated. 

As a next st^ in the analysis, we perfonnaa s^arate factor analyses 
on the discipline-^jecific itan sets using classes as the unit of analysis. 
yje. assumed that the factor analysis wcaiLd yield a single ccamnrai factor for 
each discipline with higher- and lower-order items having c^posite signs. 
Itowever, in the math, science, and social studies areas we instead found 
that the factor analyses yielded two s^arate factors, csie for hi^ier-order 
ctojectives and one for lower-order objectives (tiffi results for Eiiglish are 
described below) . The iaplicaticai was that embracing hi^^r-order objectives 
in math, science, and social studies classes did not preclude also 
en^Aiasizing lower-order objectives. 
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After performing the factor analyses, we ocBfloined itens froa the 
identified factors into s^sarate scales and assessed the reliabilities of 
the^ scales. This analysis indicated that the item sets tapping IcwBr-oEder 
objectives in the three disciplines fooaed scales with weak reliability, 
with little variability in scale means across classes, m contrast, the item 
sets t«5:ping hi^wr-order objectives foenaed quite reliable scales with scale 
laeans varying quite substantially across classes. Based an these results we 
decided to iitilize the hi^ier-onler scales in the analyses reixartad below 
but to drcp the lawer-arrier scales. 

Ihese measurenatt findings were ccaisistoit with previous r^xarts about 
instructional eifhasis in high sdmol classes. Wfe found a fairly pervasive 
enjAiasis on teaching lower-onfer cognitive skills in math, science, and 
social studies, a finding consistent with the oisservations of Goodlad (1984) 
and Powell, et al. (1985) . On the otter hand, we found variation across 
classes in the amount l " en?Aiasis placed teaching for higher-order 
thinking. Thus, tlie measuraomt results indicate a unifoon enjiiasis on basic 
sJcills and a varying ei?*jasis across classes an teaching for higher-ordfir 
thinking. 

The measureroent analysis yielded discipline-^jecif ic scales of the 
amount of ei^hasis teaciiers placed an higher-order thinking in each of their 
classes. In math ani science, the itans incliaied in these scales 
oorresporrted clceely to the descripticffB of higher-order thinking advanced 
by Cole (1991) and Piawat (1989), The itsns indicate easpbasis on key 
oonc^jts, principles, and relationships in a discipline and an enjiiaBis on 
the ise of this knowledge in pn*l«n-solving situations. 
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Msitfa . rar math, the scale had four itans. Itans in the scale vfere 
stancianaized s^arately and then averaged to farm a scale spore. To ease 
inteciretatican, this initial score was then re-scalsi to have a mean of 50 
and a standard tteviatioi of 10. The resulting scale an internal 
cxaisistency of .75 (m = 49.68, sd = 9.72). The itsos in the scale were: (1) 
unaerstandij^ the logical structure of aathfianatics; (2) understanding the 
nature of proof; (3) knowing mattoatical principles and algorithms; (4) 
thinking about what a pn^lem means and ways it might be solved. 

Science . The science scale consisted of five items v^cii tended to 
plaoe heavy ai^hasis on scientific problem-solving. Tlie procedure for 
deriviTjg ti» overall score for this scale was the same as for math. Uie 
science scale had an internal caisistency of .79 (m « 50.0, sd = 9.95) . -tte 
five items were: (1) prepare students to evaluate arguments based on 
scientific evidence; (2) teach scientific methods; (3) develop prctolero- 
solving/incjuiry skills; (4) develc^ sci^ific writing skiUs; arei (5) 
develc^ skills in lab techniques. 

Social stisiies . Ihe social stisiies scale develt^ l^re mirrors 
Newmann's (1990) discussicai of hic^ter-orcter thinking in hi^ sciiool social 
studies classes. In addition to untterstanding key ccancefA^ and principles jn 
a discipline, Nfewmann placed en|3hasis cti engaging stiK^its in challenging 
problems and having students manipulate informatiOT to solve these problens. 
Again, the overall scale score was derived in a manner similar to the 
derivation of the math and science scale scores, reailting in a four-itean 
scale (m = 49.53, sd = 9.90) living internal consistency .76. fair items 
Vfere: (1) : fonmilating and presenting arguments to a group; (2) critically 
evaluating historical accounts or arguments; (3) analyzing historical and 
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serial sciencse theori^; (4) using historical cxaxaepts to interptet 
current social Issues. 

Baalish . T!bB factor analysis of itans for the ESiglish scale yielxted 
results different frcan the results for the other discUslines. In part, the 
difference reflects the different af^aroach to higJ^r-orxter thiridng 
develc^ specialists in this area. Bereiter and S c arda m alia (1987) 
present a discussicai of higher-onter thiiddng in the areas of reading and 
writix^ that builds on Resnick and Resnick's (1977) ocHxaj^Jticai "hic^ 
literacy." Bereiter and Scardaaalia argue that higher-arder thirfcing in 
r^Klii^g and writing involves going beyond the esctracticn of meaning frtan 
siaple texts (i.e., "lower" literacy). Instead, studaits are seen to be 
engaged in "hi^ literacy" ^en tl^ read literary classics, make inferences 
about these texts through writing and discussion, and when ti^ atteanpt to 
gain personal meaning from the literature they are reading. 

The factor analysis of items for the English scale yielded two s^>arate 
factors, both of \iSiich are incliaded in this stisJy. An initial factor 
appears to denote a cono^ of "hi^ literacy" as it ^lies to reading. 
This five-item scale (in = 50.87, sd = 9.49) Yiad an internal consistency of 
.84. Uie itens were: (1) writing about literature in a variety of forms 
(freewrite, formal essays, etc.); (2) oooprehending plot and basic meaning 
of assigned literature; (3) defining literary terms; (4) eng^ing in 
literary analysis; and (5) exploring personal raqpcaises to a variety of 
literature. A secraid factor is ^secific to writing. This two-itera scale (m = 
50.79, sd = 9.44) had an internal coisistency of .60. The two iteans in the 
scale were? (1) writing about literature in a variety of farms; and (2) 
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learning to pre-write, draft, revise, and edit. Note that itea (1) in the 
reeling and writing scales are the same. 

m 

I^ctitiaiing V&riaticn ftDong Classes, Mang TeaK±iece, ani Aoong Scbools 

ISie roeasuranent analysis indicated that, for each of tl» fan- 
disciplines studied, ttoe is reliable class-to-class variaticai in the 
extent to vdiich teachers eijiiasize higter-order learning objectives, ^fe knew 
that the 1205 classes uncJer study vary in this vay because cfily if such 
variaticai existed could the scales mat measure siK:h instructicxial 
objectives achieve reasaiably high internal oorsistencies with modest 
manbers of iteas per scale. However, this reliable class-to-class variaticai 
could arise for three very different reascsis, each having funaamentally 
different iiiplications for understanding how teaci^rs develc^ instructional 
goals. 

First, classes ooold vary reliably L.^use the sane teacher 
differentiates her objectives across the different classes to vAiich she is 
assigned. We call this reliable intra-teacher variation. Notice that it 
would be absurd to label teachers ••hi^ier-order tochers" or »'lower-order 
teachers" if the main source of reliable variaticai anong classes is within 
teachers. Rather, it would be cnKiial to understand ttm characteristics of 
classes that elicit higher-order cibjectivss and to understand the basis of a 
teacher's differential jiKigiaents across classes reyarding the ^^>ropriate 
c^jectives. 

Second, there could be reliable variation across classes because there 
are important differences sssang teachers in en?hasis c^ higher-tander 
cS)jectives. We call this reliable inter-taacher variaticai. In the extraroe 

m 

case, there would be m> variaticai within te»d»rs across classes, that is, a 
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teacher would puDcsi^ exEKAly the same otojectives in each of her classes. In 
this ii'^tance, we should waste no tline stixiying hcu characteristics of the 
different classes to which a teacl^ is assigned infli^noe that te a c t w r's 
choice of dajectives because the choice never varies. Rather, we should 
focus on dif f erenoes among teachers that predict their pursuit of iif f«:ent 
objectives. 

Uiiid, it be mic^ that reliable variation amraig classes arises because 
schools vary substantially in the otojectives pursued their teachers. We 
call this reliable inter-school variatiai. In the extrane case, every 
teacher in a school wau3d pursi» ejcactly tte sane objectives in every class 
so that any differences awaig cAsjectives pursued for dif fenKtt classes are 
strictly determined the sciK»l in ^ch that class is located. In this 
instance it would be futile to stucly either class differences or teacher 
differences that predict variatioi within a school. Rather, one should 
ccff>centrate on unoovering Iww different schools shape the objectives of each 
teadier within them. 

Ifeing methods described in detail in RaudKibush, Rowan, and Kang 
(1991) , we deocBpased tte variance in the outoome measures into tte three 
ccoponents described above. Ihis analysis was based cn a three-level 
hierartiiical linear model using the ocnpiter program HliD (Raiidenbush, Bryk, 
Seltzer, & Oongdon, 1990) . Uiis program produces maximum likelihood 
estimates of the variance and oovarianoe oonponents based csi unbalanced 
data. In the sinplest three-level model, v^ch we refer to as the "baseline" 
mcxiel, there are no predictor variables. Later, we shall utilize a three- 
level regression mot'el in an attaipt to predict tte variatiai identified by 
the base mc3dei. Based on the variance deocnpositicai froro tl^ baselii^ model, 
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one can estiaaate the reliability of inber-teacfcer and inter-^iool 
diffecenoes in ii^tmctional objectives, lie also can obtain a rou^ picture 
of the reliability of intra-teaci^ differaioes frcm this model. lt» results 
are illiadnating, and vary substantially across the four disciplines. 



Insert Table 2 About Here 

Decaanposincr the Variaticai Anom Math Classes 

Table 2 s^iows that the intra-teactter variance in higber-onJer math 
objectives is estimated at 60.11, the inter-teacher variance at 33.60, and 
the inter-school variance at .09. Hence, 64.1 percent of the variance in 
hi0^-order objectives is within teacters, 35.8 percent is amcjig teachers 
within schools, and a trivial proportion of the variance lies among schools. 
Two other statistics are helpful in interpreting these variance ccBi|XHTents. 
First, the Table presents chi-square tests of the null hypothesis that the 
true variance among teacters within schools is null, in inihich case the 
estimated variance of 33.50 is an artifact of chance. Hois hypothesis is 
easily rejected since the observed chi-square of 224.17 far surpasses the 
critical valiae at the -001 level based c»i 60 degrees of freetoi. Simil a rly, 
we can test the null hypothesis that the true variance among schools is 
null. In this case we cannot reject this null hypothesis because values of 
an estimated variance near ours (.01) are highly plausible v^ien the null 
hypothesis is true. 

Ihe table also provides informatic^i about the reliability of estimates 
at the teacher and school levels. Uie reliability for discriminating amcxig 
teachers within a school is estimated to be .43, while the reliability for 
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discrifflinatii^ anoig s<±ools is estiaated to be a trivial .01. The three- 
level ptm j idM does not produoe estimates of the reliability of intxa-tea«*fir 
differences. However, we Jokjw that the internal ocaisistency of ttie scale 
score for natii classes is .75 (see Table 1) , ijjplying that about 24 % of the 
total variance in the scale scores is attributable to neasuranent error - 
TSiis r^aresents a variance of about 23.1; when ccnpared to tte intra-teaciier 
variance estiaate of 60.1, \m see that about (60.1-23.1)/60,1 or 62% of the 
intra-teacher variance is reliable. 

In sa:i, the majority of the variance on the math scale is intra-teacher 
variance vrith nearly all of the ranaining variance being inter-teacher 
variance. There is little eviitence of inter-school variance. Althow^ the 
teacher-level variance is statistically sicpiif leant and substantial in 
magnitixte, differences saxsng teachers are less reliable than are intra- 
teacher differences. 2 

These results encourage a search for dif ferere:^ anoig the classes to 
which a teacher is assigned that might p ^te large ocsrpor^nt of intra- 

teacher variation. The data also sJkjw potential for using teacher 
differences to predict teacher variation within schools. The data provide 
little hc^ for a search for school effects on the math scale. 
Deooaiposiin v^iation flncm Science Classy 

The results for science are listed in ti^ secxaid column of Table 2. Hie 
estimated intra-teacher variance is 38.71; the estiioated inter-taacher 



2ahe reliability of the data for discriminating aaaaog teachers is 
li2nited by the runber of classes pes. teacher, but this nuaSser re^ts frcaa 
the stnK*ure of secotxiary ediffiaticsi snd not trxM the tei^ of niB stwdy. 
IncliJding more iters would in^irove the teadier- - level reliability . The 
substantial variation within teachers across classes rediases the reliability 
of the data for understanding differences asncHig teaxisers. 
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variare53 is 59.50; and the estimated inter-scteol varisancB is 1.37. Bjus wb 
estimate tiat 38.9 % of the total varianoe is intxa-teaciier variance, 59.8 * 
is inter-teacher variarce, and only 1.4 % is inter-sdKX>l varianoe. Thus, 
the results differ f ran the math results in that tbB majority of variation 
is at the teacher level, >*iile a substantial fractiai is within teachers. 
The results are li3» the math results in that little of the variation is 
ammg schools. &>ce again, the hypothesis that teachers within sdwols do 
not vary is easily rejec±ed while the hypothesis that schools do not vary is 
readily retained. 

De^ite a large coaiixsient of inter-teacher variance, the reliability 
for discriminating axoor^ teachers within sdiools is roodest (see note 2) at 
.49. The inter-teacher variance clearly has a reliable ocniJCHient because 
tlie estiaated intra-teaciier variance of 38.71 is nearly ckajble the 
estimated roeasureanent error varianoe oonfxsient of 20.6. 
neccmiDosina the Vari ation Among .gnrial .StiKijes Clgs^ 

The results for social studies are listed in the third column of Table 
2. The estimated intra-teacher variance is 19.24; tte estimated inter- 
teacher variance is 63.71; and the estimated inter-school variance is 
11.43. Ihus, about 20.4 % of tl» variance is within teachers, 67.5 % is , 
amtxig teachers within schools, and 12.1 % is ammg schools. Ihus, the 
majority of variation is at the teaciier level, and, not surprisingly, the 
hypothesis that teaciiers within schools do not vary is easily rejected. In 
this case, the hypothesis that schools do not vary can be rejected at the 
mn^-ginal significance level of p = .03. Thus, there is sonie evidence of 
school-to-school variance for social studies. 
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De^ite the large ocnpcsient of inter-teaciier variance, the reliability 
for discriiainatiiig amxng teactaers within schools reoains a modest .53. Uie 
school-level reliability is estiaiated to be .29. -me intra-teacher variance 
sttaws less evidence of having a reliable ocnpcaient than for math and science 
because the intca-^teact»r variancse estimate is about the same as the 
estinated measurement error variance ocn^xxient. 
Tvv;,^^f^|,pf^^p q the Variation fsacm Pwlis^i Clpgs^ 

Recall that, for Biglish, two scales emesrged, ana for literary ea!*asis 
and one for r^jSiasis cti writing. We consider each belcw. 

Literary mhasis . "She fourth column of Table 2 lists the variance 
estimates, hypothesis tests, and reliabilities for literdry erjihasis. In 
sum, we found that 50.8 % of the variance was within teachers; 35.5 % among 
teachers within schools, and 13.7 % ssaong schools. Both the inter-teacher 
and inter-sciiool variances were significantly greater than zero. Strcaig 
evidence existed that a reliable ocnixsient of variation existed within 
•teachers. 

Writing eanphasis . Wte found that 35.4 % of the variatic»i was within 
teachers; 46.7 % was among teachers within schools, and 17.9 % was among 
schools. Both the inter-teacher inter-sdwol variances were significantly 
greater than zero. Evidence that of reliable intra-teacher veriance wr^s weak. 
amsnarv 

Deccnpoeition of variance in these scales is ir^xartant because it has 
stroffig iB5>lications for where csie might, lode to explain %Aiy classes vary in 
terns of the instructicaal (Ajjectives teachers pursue. In this regard, we 
discovered inixjrtarrt disciplinary differences. Ihere was little evidence of 
inter-school variance in math or science objectives, while evidence of 
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inter-sciKXJl variance was manifest tar both social stisiies and English 
oiojectives. lar^ and reliable ocsi?XH^ents of intra-teactoer variaiwe were 
found far math and science, \td.le inter-teacher variance was more inpartant 
in social studies. In English the results wer^. a bit more ocarplicated with 
nost variation in literary cd»jectlves found to lie vdthin teactiers and most 
of the variation in writing dajectives found to lie among teachers. Having 
identified the ccnponents of variance in each discipline, the next task of 
the analysis vas to eiploy a three-level regression nodel to predict this 
variation. 

GorceLLates of leveling f oar Hi^aer-Ckder Huiddng 

A pproach 

far each discipline, multilevel regression models were fitted in three 
stages. First, predictors that vary within teachers were ^jecif ied in an 
intraH:eacher predictiOT iKxtel. Uiese included the two indicators for 
student track (the academic and honors indicators) , stiaSent grade, and 
teacher pr^aration. ^ The analysis also controlled for class size, 
^jecifyii^ the intra-teacher predictors enabled us to estimate the adjusted 
intra-teacher and inter-teacher varianoe, that is, the amount of variance 
within and ainca^ teachers after coTtrolling for the effects of the classes 
to vhich they were assigned. 

In the next stage, teacher bac3oground variables, including years of 
experience, sex, and raxx, were added and their effects estimted in an 
initial inter^teacher model. O untr ol for siKh backgrownd characteristics is 
iaportant to insure that estimates of hypothesized effects were not biassd 

^Recall that teacher preparation varied fran class to class because we 
asked each teacher to report her level of pr^aration to teach the 
particaalar subject matter in each class. 
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by imocsitrolled badcground cijaracteristdcs. Predictors with ooefficlents 
less than 1.5 tines their estijaated standard errors were toitatively dn^^ped 
frcsn the m od el * 

At the third stage, the inter-teacher predictors hypothesized to 
infliienoe instructicnal c^jectives were ^Ided. These included teachers' 
level of educaticn, es^ihasis on covering the curriculiM, rngkasis on 
achievesaent test gains, and pero^Jtions of principal leaderEhip, staff 
collaboration, and teacher oositrol. Predictors with ooeflicients found to be 
less than 1.5 times their estimated standard errors were dropped and the 
model re-estizoated. To guarantee that no predictor, incliiding teacher 
background characteristics, could have been mistakenly dn^iped frcsn the 
mod£l, resic'uals were regressed on variables excluded frcm the model. If the 
e^:|an»aiflate "t-to-enter" (see Raud^ibush, Bcyk, Seltzer, & Oomg^an, 1990) 
exceeded 1.5, that predictor ves re-entered into tl» analysis. Henoe, for 
each outocane we arrived at a final model including predictors related to the 
outccsne and esocliKling predictors unrelated to the ai to ca n e. Vie used the 
relatively liberal criterion of t = 1.5 because we worried more about the 
bias that might arise frcro failing to ^>ecify a predictor than about the 
lade of efficiency tj»t arises the mcxiel is sli^tly over-fit. 

After estimating the final loodBl for each outccsne, ve assessed the 
amc^mt of inter-t^d^ variance explaii^. Ihis is the difference between 
the adji2sted inter-teacher variance (based on the intra-teacher model) and 
the residual inter-te»Aer variance (based on the final model) divided by 
tl» adjusted teacher level ^m-ianoe. 

With only 16 sciKX3li>, the sanple offered only limted c^iportunities to 
model the variatim amcaig sciiools in that identifying and ccaitroUing f or 
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relevant oovariates and theoretically ispoctant pcBdictors would be of 
questionable validity vdth only 15 degrees of freedcas. This slKsrtocaaing is 
unisportant in the case of HBtheniatics and science given lac^ of evidsice 
that sctiools varied on the outcome. 

Ihe results for the final ncdels in ^cii discipline are presented in 
Table 3. Potentiea predictors are T1st-<?d in the first oolumn. Oolunais 2-6 
provide results for math, science, social studies, litexature, and writing. 
If a predictor vas not related to an outocaoe, the table leaves that eitry 
blank. The results for math and science were quite different from the 
results for social studies and S^lish (literature and writing) . We 
therefore describe these two sets of results separately. 



Ij^ert Table 3 About Here 

Results for Mattonatics and ScieiKse 

Effects of track and ctrade . The crucial results for nathematics and 
science are the truly massive effects of tracSc. In uath, the dsgrem of 
en^iiasis on hi^ier-order ctojectives is, on average, 10.50 points hic^ber for 
academic classes than for n«i-acadfiBiic classes (t - 11.34) . The gep between 
hcfrars clafses and non-acateauic classes is 17.44 points (t = 14.52) . 
Recalling that the standard deviatiOT of the math higher-order teaching 
scale is slightly less than 10 points, we see that the acacteroic- 
rnnacademic gap exceeds a standard deviation in m^nitixte and the gap 
betw^n honors and ron-acotemic classes estoeeds 1.7 standard deviation 
units. 

Large track effects appeea: in science as well. 'Rie acadeanic-iKm- 
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^adanic gap is 10.25 (t = U.30) , tlKJUc^ in this case the honcsts-non- 
acadsnic gap is similar at 12.53 points (t » lo.lO) . 

There are sane differencses between the math and science re^ts. In 
math, a significant effect of grade apijears, b = 1.38, t « 3.41. This result 
duplies, far exanple, that the degree of en?4iasis an hi^ier-onier objectives 
would be 3*1.38 = 4.14 points hi^ier far seniors than for fre^nnen, an 
effect sli^tly in excess of .41 standard desdation units. 1S» gr^ effect 
in sci«we is in the same direction, but is smaller and of marginal 
statistical significance, b = .78, t 1.66, iaplying an expected g;^ 
between seniors and fre^anen just exceeding 3*. 78 = .23 standard cteviation 
units. 

Tteacher tH:ep ^t^i--i,fln aryi aroanizatiOTal effects. Results for the two 
outcomes are quite similar with regard to teacto" pnQaraticn and 
organizatiOTal effects. No effect of level of pr^JaraticHi vras manifest for 
either outcome, and in science, no tesKdier educaticsi effect appeared. In 
math, the teacto: educaticai effect vas in a directicsi c^;posite to that 
predicted, b = -4.06, t = -2.19. Ito arganizatioial effects ^jpeared in 
science. In math, a sanall tendency for teachers sj|4iasizing curriculum 
covera^ to also ai^jhasize hi^ier-orto dbjectives appeared, tut failed to 
aciiievB conventiaTal levels of significance, b = 1.22, t ~ 1.62 p > .10. In 
sum, the analysis revealed no si^^xart for the explanations based cm teacher 
preparation and arganizaticaial design effects for mathanatics or science. 

Ex planatory power of the model . Ihe incxael aocxxmted for an iiopressive 
59.6 % of the within-teacher variance for math and 47.6 % for science 
(l^le 4) . Given the level of measurement error variance dis m > spf »ri earlier. 
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these statistics quite substantially unto-refxsrt the e)?)lanatory power of 
the model at this level. 



Iraert Table 4 About Here 



Neither inodel explains substantial intep-teaciwr variance. Yoc 
science, none of tl« variance is e3q)laineca because no teaciier-levBl 
ptredictars were significantly related to the aitccnra. Itar math, the model 
accounted for about seven percent of the inter-teat*er variance. 
p^lts for fgocial Studies and miisn 

y ! ffects of trade and oracte . ajbstantial trade effects ^^Jeared in all 
three areas (social studies, literature, and writing) , but the effects were 
not as massive as in math and science. For exanple, in social stwiifis, the 
between acadeanic and non-acadp 3 classes in higher-ordfir enfhasis was 
3.56 points (t = 3.10) and the betaken toxars and non-academic classes 
was 9.07 points (t = 8.06) . Again the standard deviation is slightly below 
10 points so these effects can be interpreted as just exceeding .36 and .91 
standard deviaUcm units, re^)ectively. Patterns for writing and Uterature 
are quite similar. NC positive effect of grade c^jpeared in any area, thou^ 
unexpectedly, negative effects of grade appeared in tl» two aiglish 
subjects. 

pyfects of tearfier praaaraf ir^ and educaticai. Significantly positive 
effects of teacher level of pr^araticai ^^peared for social staaJies (b = 
2.74, t = 3.01) and for literature (b = 3.57, t = 3.40). These represoit 
expected gsps in higher-ortJer eajdiasis between classes for ^ch teaciiers 
feel "very well pr^ared" and other classes. No sucJi effect appeared for 
writing. No effects of the overall level of teacher edtK=ation appeared in 
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any of the areas, inplying that no effect of having eazned a masters degree 
was present. 

Effects of Q mani2at:icmal ctesion. Rivorable effects of s^portive 
principal leatiecship appeared in the two Qiglish subjects (b = 1.52, t » 
1.71 in literature; b = 3.14, t = 2.75 in writing;) but not in social 
studies. A favorable teacto c o ntrol effect appeared in s o ci a l studies (b = 
3.91, t «= 2.29) , but not Qigli^. To gauge the magnitudes of these effects, 
^standardized coefficients ("betas'*) nay be ocnpited as beta = bSjc/Sy, %*Jere 
Sx and Sy are tte standard deviations of predictor and outocaaa given in 
Table 1. Applying these fonmalas leads, for exanple, to standardized 
estimates of .24 for the effect of principal lea d ership in writing and .23 
for the effect of teacter control in social studies. Ito effect of staff 
oollaboraticn was found in any subject area. 

Recall that we hM hypotl^ized that emhases cm curriculum coverage 
and evaluating teaching in terms of achievement gains would be linked to a 
^l^»o-oasflrt ai54iaf.is on higter-order ctojectives. No evid«K3e eanerged to 
st^jport these l^potheses. In fact, an en?4iasis cai achievsnatt gains was 
positively associated with teaching for hi^ier-arder thinking in social 
studies (b = 2.46, t = 3.09) ; and an esi|4iasis cai curriculum coverage was 
positively related to such teaching for higher-order thinking in literature 

(b = 2.30, t = 4.39). 

Bq3lanatrr\^ power of the models . As ocnpared to math and science, the 
mcadels for social studies, literature, and writing were less powerful in 
explaining intra-teaci^ variance and mace powerful in explaining inter- 
teaciier variance (liable 4) . Ihis is not surprising. Itack effects were not 
as massive in the three humanities as they were in math and sci^xse, while 
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teaciier and ocganizatiQnal predictors were mace helpful an tte haaoanities 

than in math or scienoe. 

Eferoent^Bs of intra-teaciier variance es^lained ware 26.5, X5.1, and 
19.7 for social studies, literature, and writing, respectively. 
oocre^xKxiin? percentages of inter-teacto variance e3q)lained were 25.3, 
40.6, and 13.5. 

Discussicn 

A fundamental contradiction between currsit edixational tt^ory and 
practice provides the motivaticxi for the present inquiry. On the one hand, 
an emerging ccj^tous amraig educational theorists is that fostering hic^ier- 
oEder thinking ought to be a principal goal of instruction in aU acadsnic 
subjects for all students. In contrast, field wackers observing teaciiing 
practice in the IB, both at th& primary and secondary levels, have 
described teacher-student interactions that focus primarily on enpirical and 
procedural issues and only rarely on higher-order thinking including the 
cceativB application of fundamental principles to novel situations, the 
criticism and synthesis of owitrasting viewpoints, or the cxsnstructicxi of 
alternative es^lanaticais. Ethnogre^c research cited earlier suggests that 
teaching for higher-order thinking, yAm\ it does occur, is far more likely 
to occur in high-ability classes than in low-ability classes, thoucfi 
theorists claim ttet the pursuit of such objectives is particularly 
important for students with limited acatemic bac3?gn3und. 
Measuring Emdiasis cn Hioh er-Qrder Objectives 

Wfe sought to evaluate plausible alternative explanations for variation 
in the i^icsuit of hi^ier-onaer instructional c^jectives. "Bxis evaluatim 
required, first, accurate measurement of the degree of eanjdiasis an hicjier- 
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onJer cstojectives in each of fan: subject ax^eas. Itiat we learned about this 
neasur^nsrxt pcobloa my be of vali^ to future incpiizy on this issxsrtant 
tcpic- Hie items desi^ied to tap snptmsis on higher^-onler c&jectivas, 
ad^jted frcrn the Naticnal Biiicaticml Longitudinal Survey of 1990, proved 
highly useful. A typical result is that a scale ocHTsisting of just four 
itens achieves an internal consistency of about .75 across all classes. C&i 
the other hand, itens designed to t^ Icwer^onter enjteses, incl\»iing 
insnorization of facts and practice chi paxxaedures, were not helpful. Rather 
than loading negatively on tim higher-order scale, th^ ocsistituted a 
second, weakly reliable factor, This pattern was renarfcably ocawerc^nt 
across the four disciplines. J^parently, the pursuit of lcwer-<arder 
cbjectives does not preclude the simultaneous pursuit of hi^jer-anter 
objectives, at least, not in the minds of th& tochers in this study. 

The iirplications for future measuranent efforts seem clear. It wculd be 
wise to write more itens t^ing the higher-order dimension for each subject 
area. Using variance ocapcxient estimates frm internal consistency analysis, 
we can estimate the esipected internal cmsistency of each scale as a 
functitxi of the number of iteans in that scale. For exanple, if tl» math 
scale consisted of 10 items ratter than four, we estimate that the intemca 
consistency of the scale would rise fron .75 to around .88; a 15 it«a scale 
ou^t to produce an internal consistency of about .92. Having more items 
might also enable the measurement of interesting sub-dimensions of teaching 
for hic^ier-order thihlcing, including, for exanple, a sub-scale that taps 
eaijiiasis on hi^:ier-arder cognitive ocaitent and a sub-scale that eajAiasizes 
classrocsn interactions that facilitate higher-order discourse. 
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Evaluating Alternative Explanations 

tfe also ocsinsitteinBd three explanaticsis for the under-en?iiasis on 
teac4*i2ig for hi^ier-onJer thiricing. First, we reascsied that caono^Jticns of 
teaciiii^ and learning rooted in the seooirfary curriculum may oxxxarage 
teaching for hi^ier-ortter thinking csily in hi^i-track classes and mace 
advaiiced courses in a hierarchically ocdsred seqi«noe. We predicted that 
these effects would vary across disciplines because the curriculum in ttese 
disciplines vary in the degree to which ths^ are hierarchically organized 
accortaing to track ani grade. SeccsTd, vfe argued that inaJequate teacher 
preparaticffi mig^t ptuo ^j t a "transmission style" of teaching that avoids 
challenging teacher-stuctent interacticHis. Such inaiequate pr^aaration cxuld 
arise because the overall level of teacter ediwation is inadequate or 
because of a poor match between teacher badtground and particular class 
assignments. Ihird, we hypothesized that school organizational structures 
put in place to oi^hasize direct instruction for basic skills may svippaxss 
teachers' adopticai of higher-order objectives. On the other hand, 
organizational environments characterized by a^jportive administrative 
leadership, staff collaboration, and teaci^ ooTtrol over the conditions of 
instruction were hypothesized to facilitate the jxirsuit of higher-order 
instructicaial goals. 

Itffi most prcaninent reaiLt of our study was the powerful link between 
track and esfhasis on higher-order c^jectives. This link was strong and 
hi^y significant statistically in every discipline, but was es^ially 
pnmounced in math and science. Ihe secraid central result was that the 
ootrelates of teaching for hi<^ier-order thinking did d^jend upcHi the 
discipline. Hypothesized effects of gr^ ^^jeared caily in math and sci€a»e. 
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N6 l^pothfisized effects of teaciier ^le^aration a|3peared in Bath and sciencae, 
but iji5»rtant positive ef f ec±s of teacd^ preparation did fi^^jear in social 
studies and literature. No oinganizatianal effects a^Jpeared in math and 
scieKse, but sam etvidenoe of such effects were manifest in social sci«ioe 
and on both Ehgli^ scales (writing and literature) . 

The teacher prsparation effects arising in social studies and 
literature were effects of the teacher's self -reported pr^>araticai to teadi 
a particular class. They were not effects of the overall level of teacher 
educaticHi. Our results provided no evidence that siicply having ctotained a 
master's degree predisposes a teacher to jxarsi^ hic^ier-order objectives. 
Rather, the match between the teacher's prgaratiOT and the subject matter 
of a particular class appeared to be linked to hi^ier-onter enjjhasis. 

Tte otganizatianal effects were more ccarplicated than anticipated. 
SoTOB evidence of positive effects of suRxartive le^iership and teadier 
control a^Jsared; supportive principal leadership predicted an eirf^asis on 
hi^^er^orxfer rfajectives in writing and literature, and teacher cxxntrol over 
the conditions of instriKrticai predicted higl'ter-ointer cA>jectives in social 
studies. However, emphasis an curriculian coverage and on aooountability for 
achievesnent gains did rest relate to instructional ctojectives as 
hypothesized. In fact, rather than predicting lew ea^hasis csi hi^ter-orxSer 
objectives, enphasis on curriculum covers predicted a hi^ffir-order 
en^ihasis in literature, and oaicem with achievement gains predicted a 
hi^ier--order esi^^hasis in social studies, 
pi ^licatiais for Policy and Future Researgh 

^^b^t,in s and sci«K» . TS^ findings suggest that differentiated 
instructicaial objectives are strmgly institutionalized in the secondary 
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laatlisiBtics and science curricula. Hi those disciplines, the typical teacher 
sets very different objectives for wm-oolle^ smd colle^ classes, and 
there is evidence, especially in laathanatics but fsuggestive also in science, 
that such a teaciier sets higher-octter objectives for courses taken later in 
a prescribed sequence. Bie grate effect in inathenatics is not surprising: 
ThB seoonJary math curriculum is different frcm the other aaricula in that 
the seqtifyrp of courses is to a larger e>ctent hierarchical; certain ocurses 
(e.g. , calculus) cannot be taken before certain other courses (e.g. , 
alg^sra) . 

Oonanentary cited at the beginning of this paper rejects the contention 
that hi^ier-order objectives are less appn^sriate for low-trade classes or 
more elenentary classes than for hic^ track classes or more advanced 
classes. However, our sti^ provides quite strcsig evidsKJe that a diverse 
set of secondary math and science tochers disagree. If promoting higher- 
order thiiiking in seocaic3ary aath and science is an inportant goal for 
educational policy, the advocates of siKh a policy mast recognize that 
formidable institutional obstacles confront them. Panculas like providing 
loore preservice teacher education, ijiproving the match betorfeen teaciier 
knowledge and teaching assigranent, de-€5B?*iasiziiig standardized tests, or 
inplesnenting school ocganizatianal reforms are by thsnselves or together 
unlikely to raise the conc^Jtual level of discourse in tbs. secondary math 
and science classes we stisiied. Ihis does not mean that refonns of 
preservice ©ducatirai or &±ool organization cannot be helpful, ajt such 
refoos naast apparently challenge wictely held ocaic^>ticaTS of teaching and 
learning rcoted in a curriculum that seesns to have invariant characteristics 
across diverse saoOTsdary schools. 
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Cm mi^t ciiallenge thsse findii^ by critldzing the w&isares of 
tma£iier preparaticn and csTganizaticml awixcmsnt esployBd in this stuc^. 
One might e^jecially challencfe tte sSpsenoe of a large sanple of sciK»ls ttat 
would have facilitated an explaration of sctool to school differeaiues. While 
ve certainly encrurage researchers to work an itapsccfved tocher and school 
ineasures, our findings for nath and science are strengtl^ned hy results of 
our variance deocmposition. In both roath and science, large cxsrponents of 
variation are within-teachers . SiKh variation cannot be aoocunted for by the 
main effects of teachsr^level characteristics, no natter hew well measured. 
Moreover, substantial prc^xjrtions of this large intra-te^dier variance are 
acocfunted for track. So our finding regarding track cannot be challenged 
by sb^iies that inprcfve m^suresnent of teacher characteristics. 

Moreover, no evidence eanercped of iaportant school-to-sdiool differences 
in hic^hex-order esi^Dhasis in math and science. So careful measureoient of 
sctK»l-level characteristics, tha^ certainly a laixSable ^sal, would not 
liJcEly be of mxch assistance in under^^tanding the differentiation of 
d?jectivBS in these data. A critic might argue that idiosyncracies in cxjr 
sample rsay have worked against finding school differexses. However, we were 
able to find evidence of significant school differences in the other 
disciplines. Ihe scSiool-to-sctexDl invariance we r^xsrt is specific to math 
and science. This discipline-specificity of findings is in itself an 
ip:portant result requiring further ejqjloration. 

Social studies and Brrlish . Important trade effects a{?»ar in these 
discipliros as well, tlKu^ they are not as powerful as in math and science. 
As in the case of math and science, this finding should encourage reformers 
to ccs^ider the ir^titutimal bases of the differ antiaticffi of instnK±ional 
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objectives across classes. Wittespnead ocaiogjtiais about the rele^ranoe of 
higher-on3er ctojectives for differ^ kinds of stusients, arguably rooted in 
the secondary curriculum, should not be igrxa^ed. 

However, the ^pearance of te^aiea: pn^jaraticn effects and school 
organization effects prwides scane l^jpe to poUcymakers seeking to 
ixKSBase the pr&ml&noe of hi^ier-arder instricticn throu^ ref arms of 
ptreservioB educaticn and scliool orcpnization alcM>e. Htb capacity of a 
teacher to strive for hii^jer-«nter dajectives in each class appears to be 
undermined bj^ mianatci^s between prior training or intssrest and ^lecif ic 
class assignments. And these finding amjrage furtl^ exploration of how 
supportive organizatitaial envircsments might raise the level of discourse. 

Critics mi^t again argi» that better ineasurCTient of teacher 
characteristics would shed more lic^t an haa iirproved teacher preparaticai, 
selection, and assignmatt roi«^t irearease teaching for hi^ier-order thihking; 
and that iaproved measureaent of organizational characteristics rai^t 
uncover important insights about the likely effects of organizatLiCTTal 
reform. In the case of social stores and English, we would agree. Our 
results show large ccs^xsients of inter-teacdier and inter-sdiool variation 
in the humanities. Ihoisgh these findings do not unttermine the iuportanoe of 
track, tl^ do encourage tt^ specificati<»i of better theories and measures 
to understand how teacher and school differences influence th? pursuit of 
teaching for hi^ier-ocder thinking in social sstudies and mgliiih. 
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T&ble 1 Descriptive Statistics for a) Class-Iievel and b) Teacher-Ifivel 
Variables 



a) Class-Level Variables 



Variables 



Coding and Range 



1. Class size^ 

2. student Graae Level^ 

Z, Honacs Track vs 
NcHi-hanac track 

4. Acadanic Track vs 
Nfan-academic Track 

5. Level of Preparation 



6. ED^^hasis on Literary 
Appreciation in 
Eriglish Classes 

5 itean^ 

Reliability = .84 

7. Bcphasis on Writing 
in ESiglish Classes 

2 items^ 

Reliability = .60 

8. Di;]basis on 
Hi^ier-Qnier Uiinking 
in Social Studies 

4 iteans® 

Reliability = .76 

9. BiftTBsis on 
Hi^ier-order Thinking 
in Mathenatics 

4 iteans^ 

Reliability = .75 

10. Ea^tssia on 

Higher order thinking 
in Science 
5 iteafis^ 

Reliability = .79 



(2, 38) 
(1, 4) 

0 = ixsHicKKas track 

1 * advanced or honors 



0 = non-academic tr^ik .42 

1 = academic track 

0 « not very weU-pir^ared .61 

1 == very well pr^jared 



(16.43, 60.97) 



(15.71, 59.46) 



(29.22, 66.60) 



(26.93, 63.89) 



(22.91, 65.60) 



50.87 



50.79 



49.53 



49.68 



50.05 



St. Dev. 



25.69 


6.47 


2.34 


1.00 


.16 


.37 



.49 



.49 



9.49 



9.44 



9.90 



9.72 



9.95 
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Notes to Table la 
agigss^igg was oentarBd around the grani mean in tte HIM analysis. 
bp^i^« ^- grade level was OMitfisred around the grand mean in the HIM analysis, 
oihere are 89 Ehglish teachers and 323 SSigli^ Classes, 
dniere are 65 social studies teachers and 272 social studies classes. 
^Ihere are 74 Matheoatics teachers and 304 Matheanatics classes. 
9niere are 75 sciencse teachers and 306 classes. 
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b) Iteaciffir-Ifivel Variables 



Variables 



Coding and Range 



1. Years of ES<perienc3e^ 

2. Level of Bducatiai 

3. Race 



4. Sex 

5. Staff ODoperatica^ 

reliability = .86 

6. Teaciffir ccsitrol^ 

9 iteoB 

reliabUity = .75 

7. Principal LesKiershiF^ 

13 itesQs 

reliabUity = .92 

8- Teadher LBaming^ 
3 itenjs 

reliability = .71 

9. lUportanoe of Oovering 
the Qirriculian 



{1, 40) 



20.02 



0 
1 

0 
1 



no master's degx^ .70 
has naster*s degree 



others 
vMtes 



0 » female 

1 = nale 



(-2.51, 1.49) 



(-2.02, 1.22) 



(-2-33, 1.34) 



(-2.35, 1.53) 



(1, 6) 



10. Aciiievtanait Gains Basis for (1, 6) 
jtxiging Teaching 



Notes to Table lb 



.91 



.61 



-.04 



-.02 



-.02 



-.06 



4.51 



3.97 



9.15 
.46 

.29 

.49 

.74 

.58 

.71 

.76 

1.15 
1.27 



ayearsoftegtog «as cKTtered arc^ the grand mean in the HIM analysis. 
CTSoSSSiS was centered around the gand Bean in the 
oj^H^^^roi >ras centered around the grand mean in the HIM analysis. 

was centered around the grand mean in tte HIM 

learning was centered arcxmd the grand mean in the HIM analysis. 
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'fMt*. 2: Deocnpcasiticffi of VMrianoe (no {sredictors specified) 





»ath 


Sciencse 


Social 
Studies 


Literary 


Hritijng 


Intra- 

Tteacfaer 

VSarianoe 


60.11 


38,71 


19.24 


49.24 


33.84 


Utteay- 

Teacher 

Varianoe 


33.60 


59.50 


63.71 


34.46 


44.62 


mter- 
Sciiool 
Variance 


0.09 


1.37 






17.16 


Esumactss 














0,43 






0.41 


0.45 


Inter- 
sciiool 


0.01 


O.Oo 






0.37 


Oonpcsnents of 
Vlai iancse Tests 










Inter- 












Chi-square 
Statistic 

af 

p-value 


224.17 
60 
0.01 


409.28 
60 
0.00 


576.04 
50 
0,00 


267.02 
73 
0.00 


373,09 
73 
0.00 


Inter- 
Sciiool 












Qii-square 

Statistic 

df 

p-value 


10.02 
13 

<-500 


16.45 
14 
0.29 


25.04 
14 
0.03 


28.42 
15 
0.02 


34.71 
15 
0.00 
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•I^ale 3: Predictors of BijAiasis on HCO? cajectives 

(a) Ragression coefficient estimates 

(with standard error estiinates in parentheses) 



Math Science Social li-terary Wtiting 

Studies 



'^teachgr-level 



mtercmt 43.09 44.42 47.67 44.71 46.15 

(1.91) (1.32) (1.33) (1-57) (1.76) 

Experience 



SJucaticai -4.06 
(1.85) 



-0.22 

(o.n) 



Stan. Test 2.46 

(0.79) 

Ocverage 1.22 2.30 

(0.75) (0.52) 

T. Control 3 -91 

(1.71) 

Staff Coop. 
Prin. liBad 
c;Lass-level 

Class size 

Grade 

Vca:rars 

Level of 
Prq>araticm 









1.52 


3.14 








(0.89) 


(1.11) 


0.14 


0.02 


0.04 


0.23 


0.11 


(0.07) 


(0.06) 


(0.06) 


(0.08) 


(0.07) 


1.38 


0.78 


0.46 


-0.80 


-1.10 


(0.41) 


(0.47) 


(0.44) 


(0.44) 


(0.40) 


10.50 


10.25 


3.56 


5.27 


4.26 


(0.93) 


(0.91) 


(1.15) 


(1.20) 


(1.23) 


17. .4 


12.53 


9.07 


8.95 


8.69 


(1.20) 


(1.24) 


(1.13) 


(1.23) 


(1.16) 


1.78 


-0.87 


2.74 


3.57 


-0.15 


(1.17) 


(1.05) 


(0.91) 


(1.05) 


(1.06) 
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TsAilB 3 (Oantlnued) 

b) Varianoe ccBnponaits estimates 



Math Scienoe 



Social Literary 
Studies 



Writing 



Intra- 
Teacher 

VSariance 24.29 

mtear- 
Teacher 

Viarianoe 35.35 
Inter 

SCdKSOl 

Variance 0.13 



20.27 



64.65 



2.56 



14.14 



43.88 



7.31 



41.81 



13.75 



17.30 



27.19 



38.54 



23.40 
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T^blfi 4 Variances and Variance Aooounted Itar at the Class and T3Bac±fir levels 



No Class-level 
pEHiictars predictors 
(from Table 2) only 



Class-level & Variancse 

teacl%si£>level Accounted 

predictcas foc^ 
(frcsn Table 3) 



mtra-teacher 60.11 24.30 24.29 59.7% 

IrtMsr-teaciier 33.60 39.47 35.35 10.4% 

I^tel^-scilool 0.09 0.14 0.13 

Scicaxje 

intra-teacfter 38.71 20.27 20.27 47.g 

59.50 64.65 64.65 0.0% 



Intar-teacher 



Inter-sciiool 1.37 2.56 2.56 

Social Studies 



intra-teacher 19.24 14.16 14.14 26.5% 

Inter-teadter 63.71 58.76 43.88 25.3% 

Inter-school 11.43 10.36 7.31 



Literature 

Uitra-teaciier 49.24 41.61 41.81 :^5.1% 

Inter-teacher 34,46 23.15 13.75 40.6% 

Inter-school 13.29 14.53 17.30 

Writing 

Intra-teachei 33.84 27.12 27.19 19.7% 

Inter-teacher 44.62 44.56 38.54 13.5% 

Inter-sciKJol 17.16 19.97 23.40 



Itote 

^ Percentage of intra-teacher variance a ccou n ted for - . ^ ^ 

(Variance witii IK) predictors - variance with all predictors) divided hf the 
variance with no preditors. 

F^srcenta^ of inter-teacher variance aoocunted for = 

(Variance wi-tti class-level predictors - variance with all predictoars) divided 
the variance with class-level predictors. 
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